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ON  THE  PREDICTIVE  BENEFITS  OF  FORM  10-K  BACKLOG  INFORMATION 

Abstract 

This  paper  explores  the  proposition  that  SEC  Form  10-K  backlog 
information,  which  is  reported  annually,  can  be  used  to  improve  ex- 
trapolative  forecasts  of  corporate  sales.  A  sample  of  COMPUSTAT 
firms  was  used  to  compare  the  predictiveness  of  ten  models  derived 
from  the  sales  order  identity.  Firms  were  partitioned  on  the  basis 
of  backlog-to-sales  ratios  in  order  to  assess  subsample  differences 
associated  with  average  delivery  period. 

The  results  indicate  that  10-K  backlog  information  may  be  use- 
ful in  some  contexts,  but  not  others.   In  general,  models  using  only 
sales  data  performed  quite  well,  while  models  using  backlogs  per- 
formed poorly.   Firms  with  the  shortest  delivery  periods  showed  some 
promise  for  exploiting  the  new  order  series. 


ON  THE  PREDICTIVE  BENEFITS  OF  FORM  10-K  BACKLOG  INFORMATION 

Forecasts  of  net  sales  are  important  to  managers  and  financial 
analysts  for  a  variety  of  reasons.   In  effect,  they  are  the  corner- 
stone of  the  budgeting  process  and  the  basis  upon  which  financial 
results  are  projected.   Managers  often  use  expected  revenues  to 
formulate  marketing  and  production  strategies,  whereas  financial 
analysts  use  expected  revenues  to  project  expected  results  and  to 
plan  investment  strategies. 

The  purpose  of  this  paper  is  to  explore  the  proposition  that 
Form  10-K  backlog  information,  which  is  reported  on  an  annual  basis, 
can  be  used  to  improve  extrapolative  forecasts  of  corporate  sales. 
A  company  registered  with  the  Securities  and  Exchange  Commission 
(SEC)  will  disclose  order  backlogs  when  considered  material  to  an 
understanding  of  its  business.   Pursuant  to  SEC  Regulation  S-K, 
these  disclosures  appear  within  its  description  of  the  business 
(Item  1). 

Although  unfilled  orders  have  been  used  to  investigate  aggregate 
adjustments  to  demand  changes  at  the  industry  level  (e.g.,  Zarnowitz 
[1962];  Odle,  Koshal,  and  Shukla  [1981]),  it  is  surprising  that 
similar  research  has  not  been  conducted  at  the  firm  level.   It  is 
also  surprising  that  empirical  evidence  has  not  been  generated  with 
respect  to  the  predictive  benefits  of  reported  unfilled  orders,  for 
it  can  be  presumed  that  one  of  the  main  purposes  of  backlog  infor- 
mation is  enhanced  sales  forecasting  performance. 
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In  the  present  study,  predictive  benefits  are  viewed  in  terms 
of  both  direct  and  indirect  effects  on  forecasting  performance. 
Direct  benefits  result  from  using  the  data  in  models  which  outper- 
form similar  models  not  using  such  data.   Indirect  benefits  are 
less  obvious  and  result  mainly  from  insights  gained  from  having 
the  data.   These  insights  can  be  helpful  in  understanding  the 
forecasting  environment  and  in  selecting  appropriate  forecasting 
strategies . 

BACKGROUND 
It  is  generally  recognized  that  firms  respond  to  demand  fluc- 
tuations in  three  basic  ways.   First,  the  firm  can  adjust  its  prices 
and  output  to  affect  sales.   Second,  the  firm  can  produce  to  stock 
and  use  inventories  to  cushion  the  disruptive  effects  of  fluctuating 
demand  on  production.   Third,  the  firm  can  produce  to  order  and  use 
order  backlogs  to  cushion  the  effects  of  fluctuating  demand  on 
sales  and  production.   While  these  strategies  are  not  mutually  ex- 
clusive, they  provide  a  means  of  characterizing  firms  and  industries. 
In  the  limiting  case  of  instantaneous  price-output  adjustments,  both 
finished  goods  and  unfilled  orders  would  be  nil  [Zarnowitz,  1962], 

Price-Output  Adjustments 

For  the  most  part,  researchers  have  been  concerned  with 
price-output  adjustments  as  they  relate  to  conventional  price 
theory.   This  option  implies  that  the  firm  is  willing  and  able  to 
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adjust  its  output  to  levels  of  current  demand.   However,  since  this 
reaction  may  not  be  feasible  in  many  cases,  due  to  natural  lags 
in  the  production  planning  process,  firms  usually  will  not  adopt 
this  strategy,  especially  in  the  short  run.   Fluctuations  in  pro- 
duction rates  are  often  considered  undesirable  by  managers  because 
changes  in  production  are  associated  with  reduced  efficiency  and 

increased  unit  costs.   Consequently,  reduced  input  flexibility 

2 
usually  indicates  a  need  to  stabilize  production.   Demand  and 

cost  factors  in  an  unstable  environment  thus  favor  inventory  and 

backlog  accumulations  rather  than  price-output  adjustments. 

Inventory-Backlog  Accumulations 

Firms  which  build  inventories  and  accumulate  backlogs  react 
to  business  expansions  and  contractions  in  a  series  of  marketing 
and  production  decisions.   Table  1  depicts  over  time  the  rela- 
tionship between  orders  received  (R) ,  orders  shipped  (S),  and 
production  (P)  at  selling  prices.   The  sequence  of  events  begins 
from  steady  state  (t  =  1)  where  the  firm  is  producing  as  much 
as  it  can  sell  at  prevailing  prices.   Next  (t  =  2),  the  firm 
experiences  an  increase  in  demand  for  its  products,  but  has 
not  yet  raised  production.   It  then  raises  production  (t  =  3)  in 
response  to  the  perceived  increase  in  demand.   As  demand  continues 
to  rise,  the  firm  again  (t  =  4)  raises  production.   In  the  next 
period  (t  =  5),  however,  demand  levels  out,  even  though  production 
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continues  to  increase.   In  the  following  period  (t  =  6),  demand 
begins  to  contract,  as  evidenced  by  the  relationship  between  new 
orders  and  sales.   Excess  inventories  next  (t  =  7)  dictate  reduc- 
tions in  production.   In  the  following  period  (t  =  8),  production 
again  equals  new  orders,  but  backlogs  continue  to  fall.   Production 
is  cut  back  further  (t  =  9)  in  order  to  reduce  inventory  levels 
still  more.   The  process  continues  until  a  new  steady  state  is 
reached  (t  =  10) . 

Although  every  combination  of  events  has  not  been  enumerated 
here,  Table  1  does  show  that  backlog  changes  will  lead  changes  in 
sales.   While  excess  inventories  might  also  signal  shifts  in  demand, 

various  corporate  policies,  including  certain  accounting  policies, 

3 
could  serve  to  mitigate  such  indicators.    Consequently,  in  the 

present  study,  only  the  relationship  between  orders  and  sales  was 
investigated. 

The  preceding  model  highlights  the  complementary  relationship 
between  new  orders  and  production.   It  does  not  indicate,  however, 
that  the  risks  of  building  stocks  are  often  greater  than  the  risks 
of  accumulating  orders.   Thus,  a  policy  to  produce  to  stock  could 
be  inherently  more  risky  than  a  policy  to  produce  to  order.   Indeed, 
in  many  industries  the  risk  of  order  cancellations  has  been  minimal 
[Zarnowitz,  1962],  and  backlogs  are  thus  considered  safer  and 
more  appropriate  than  inventories  as  a  means  of  smoothing  produc- 
tion, especially  in  manufacturing.   Since  inventory  and  backlog 
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accumulations  rarely  parallel  one  another,  they  have  been  treated 
here  as  essentially  separate  issues  and,  in  order  to  simplify  the 
analysis,  inventories  are  assumed  to  be  neutral  with  respect  to 
sales  over  time . 

THE  RELATIONSHIP  BETWEEN  SALES  AND  ORDERS 
The  process  of  receiving  and  completing  sales  orders  provides 
a  framework  for  relating  sales  to  orders.   This  framework,  depicted 
in  Figure  1,  is  used  to  derive  appropriate  sales  forecasting  models. 
In  essense,  it  shows  that  beginning  backlogs  plus  net  orders  received 
(i.e.,  new  orders)  will  always  equal  ending  backlogs  plus  net  orders 
shipped  (i.e.,  net  sales).   In  effect,  this  identity,  familiar  to 
every  accountant,  is  used  to  account  for  potential  sales  which  are 
not  reflected  in  the  financial  statements. 

The  sales  order  identity  reveals  three  general  approaches  to 
sales  forecasting.   First,  along  path  f,  it  indicates  that  future 
sales  may  be  largely  a  function  of  past  sales.   This  is  perhaps  the 
most  conventional  approach.   Second,  along  path  g-h,  it  shows  that 
future  sales  can  also  be  thought  of  as  a  function  of  past  orders. 
In  cases  where  sales  parallel  orders,  the  second  approach  would 
yield  results  similar  to  the  first  approach.   Third,  along  path  k, 
future  sales  can  be  viewed  as  a  function  of  unfilled  orders.   These 
relationships  are  represented  as  follows: 
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St  =  f(St-i)  (±) 


St  =  h[g(R   )]  (ii) 


St  =  k(Bt)  (iii) 


where 


S  =  orders  shipped  in  period  t, 
R  =  orders  received  in  period  t, 
B  =  orders  backlogged  at  the  end  of  period  t, 
i  =  appropriate  lag  between  observations, 
j   =  average  delivery  period. 
In  addition,  combinations  of  these  relationships  are  possible. 

RESEARCH  DESIGN 
The  present  study  was  designed  to  investigate  the  potential 
direct  and  indirect  predictive  benefits  of  10-K  backlog  information. 
A  sample  of  COMPUSTAT  firms  was  used  to  compare  the  predictive 
ability  of  various  sales  forecasting  models  and  forecasts  of  annual 
sales  were  evaluated  using  several  metrics. 

Sample 

A  sample  of  SEC-reporting  companies  with  complete  data 
for  twelve  consecutive  years  (1970-81)  was  selected  from  the 
COMPUSTAT  annual  industrial  tape.   In  all,  224  firms  satisfied 
these  criteria,  but  two  firms  with  outliers  were  excluded  in  order 
to  provide  a  sample  exactly  divisible  by  three. 
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The  sample  was  partitioned  on  the  basis  of  average  delivery- 
period  which  was  computed  for  each  firm  by  dividing  average  ending 
backlog  by  average  sales.   The  backlog-to-sales  ratio  was  used  to 
assess  the  potential  indirect  effects  of  backlogs  on  sales  fore- 
casting performance.   Firms  were  ranked  in  ascending  order  and  par- 
titioned  into  three  equal  groups  of  74  firms  each.   These  groups, 
then,  represented  short,  medium,  and  relatively  long  average  delivery 
periods  (i.e.,  backlog-to-sales  ratios). 

Sales  Forecasting  Models 

Ten  separate  models  were  selected  to  evaluate  the  predic- 
tive benefits  of  10-K  backlog  disclosures.   These  models,  based 
on  available  annual  data,  were  selected  for  the  most  part  for 
their  correspondence  to  the  sales  order  identity  depicted  in 
Figure  1.   As  such,  they  have  intuitive  appeal  and  theoretical 
support,  since  the  fundamental  relationship  between  sales  and  orders 
is  implicit  in  each  model.   In  order  to  simplify  the  discussion, 
models  have  been  grouped  into  three  basic  categories:   (1)  models 
using  only  sales  data;  (2)  models  using  orders  data;  (3)  models 
using  only  backlog  data.   New  orders  were  derived  from  the  backlogs 
and  the  sales  that  were  disclosed. 
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Notationally,  these  models  are  represented  as  follows: 
Category  I 

K   =  St-1  +  6  (1) 


St  =  (l+r)St_1  (2) 


St  =  (l+r')St_1  (3) 


St  =  ao  +  aist-i  (4) 


Category  II 

K  -  Rt-i  (5) 


St  =  (l+r)Rt  (6) 


St  =  a0  +  alRt-l  (7) 


St  =  a0  +  alRt-l  +  a2St-l  (8) 


Category  III 

K  =  ao  +  aiBt-i  (9) 

St   -  W-1Bt_1  (10) 


where 


S  =  net  sales  in  period  t, 

R  =  new  orders  in  period  t, 
t  K 

B  =  backlogged  orders  at  the  end  of  period  t, 
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r  = 


a. 

1 


W 


-1 


6  = 


average  growth  rate  in  sales  or  orders, 
predicted  growth  rate  in  GNP, 
regression  coefficients, 
inverse  of  average  delivery  period, 
drift  term. 


Error  Metrics   * 

Two  error  metrics,  mean  absolute  relative  error  (MARE)  and 
mean  squared  relative  error  (MSRE),  were  used  to  evaluate  the  pre- 
dictive ability  of  the  competing  models  in  a  two-year  holdout 
period  (1980-81).   These  metrics  represent  linear  and  quadratic 
loss  functions,  respectively,  and  both  may  be  thought  of  as  mea- 
sures of  accuracy.   Notationally,  they  were  computed  for  each  set 
of  predictions  as  follows: 


1  N 
MARE  =  s-  Z 

N  i-1 


1   N 
MSRE  «  i  I 

N  1-1 


Pi"Ai 


P. -A. 

l   l 


where : 


P.  =  predicted  sales  for  company  i, 
A.  =  actual  sales  for  company  i, 


N  =  number  of  companies  indexed  by  i. 
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Test  Procedures 

In  order  to  evaluate  the  alternative  forecasting  models,  an 
analysis  of  variance  (ANOVA)  model  was  used.   Notationally,  it  can 
be  represented  as  follows: 


X.  .,       =  u  +  a.    +  S.   +  Y,    +  ctB.  .   +  ay.,    +  By., 
ljkm  1  j  k  ij  lk  jk 


+  aBy.  .,    +  e_  ,.  .,     .  (11) 

ljk  0(ijkm) 


i  =  1,  2 10 

j   =  1,  2,    3 

k  =  1,  2 

m  =  1,  2, ...,72 


where 

u  is  the  grand  mean, 

a.  is  the  forecast  model  effect, 

l 

6.  is  the  backlog-to-sales  ratio  effect, 

y,  is  the  year  effect, 

aB...  ay.,,  By.,,  and  aBy..,  are  interactions, 
ij    lk    jk         ljk 

e^ /j  .,  \  is  experimental  error, 
0 (ijkm) 


m 


is  the  number  of  firms  in  each  backlog-to-sales  group. 


The  above  model  represents  a  three  factor  design  with  repeated 
measures  on  factor  A  (forecast  model).   Factor  B  (backlog-to- 
sales  ratio)  is  nested  under  factor  C  (year).   Using  this  model, 
the  following  null  hypotheses  were  examined  for  both  metrics: 
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H  :   There  are  no  differences  in  forecasting  performance 
among  the  ten  models. 

2 
H  :   There  are  no  differences  in  forecasting  performance 

among  the  three  backlog-to-sales  groups. 

3 
Hn:   There  are  no  differences  in  forecasting  performance 

between  years  1  and  2. 
Hypotheses  concerning  interactions  were  also  examined. 


RESULTS 

Tables  2  and  3  provide  descriptive  evidence  in  terms  of  MAREs 
and  MSREs,  respectively.   Both  mean  errors  and  mean  ranks  are  pre- 
sented for  the  complete  sample  and  for  each  delivery  period  group. 
The  tables  reveal  nominal  differences  between  certain  models,  and 
show  that  models  (1),  (2),  (3)  and  (5)  appear  to  perform  the  best, 
whereas  models  (9)  and  (10)  appear  to  perform  the  worst.   There 
also  appear  to  be  differences  in  forecast  accuracy  among  the  de- 
livery period  groups.   In  order  to  evalute  the  statistical  signi- 
ficance of  these  results,  the  ANOVA  tests  are  presented  next. 

First,  two  important  assumptions  underlying  the  repeated  measures 
ANOVA  design  are  (1)  the  population  covariances  between  pairs  of 
treatment  levels  are  constant  and  (2)  the  population  variances  for 
each  of  the  j  treatment  levels  are  homogeneous.   In  short,  a  homo- 
geneous variance-covariance  matrix  is  required,  and  if  this  condi- 
tion is  violated,  the  conventional  F-test  tends  to  overstate  the 
significance  of  results. 
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Greenhouse  and  Geisser  (1959)  provide  a  measure  of  the  extent 
to  which  the  variance-covariance  matrix  departs  from  homogeneity. 
We  performed  this  test  for  both  the  MARE  and  the  MSRE  metrics  and 
adjusted  the  degrees  of  freedom  for  the  F-test  accordingly.   The 
ANOVA  results,  based  on  this  conservative  F_-test,  are  presented  in 
Table  4.   For  both  error  metrics,  there  is  a  significant  model 
effect,  as  well  as  a  significant  interaction  between  model  and 
backlog-to-sales  group,  but  the  other  interactions  are  not  highly 
significant. 

In  order  to  assess  further  any  model  effect,  pairwise  compar- 
isons were  performed  for  all  possible  model  pairs.   These  results 
appear  in  Table  5.   These  comparisons  show  that  the  ten  models  can 
be  partitioned  into  two  groups  based  on  relative  forecast  accuracy. 
Moreover,  models  (4),  (6),  (9),  and  (10)  performed  significantly 
worse,  on  average,  than  the  other  six  models.   Interestingly,  both 
backlog  models  performed  poorly  relative  to  the  six  most  accurate 
models.   Also,  it  can  be  noted  that  there  is  apparently  little 
basis  on  which  to  choose  between  models  that  are  a  function  of 
past  sales  and  those  models  that  are  a  function  of  past  orders. 

The  statistically  significant  interaction  between  forecast 
model  and  backlog-to-sales  group  was  also  interesting.   First, 
however,  some  understanding  of  the  nature  of  the  model-group  inter- 
action can  be  gained  by  reviewing  Tables  2  and  3.   Indeed,  a  pat- 
tern emerges  if  we  restrict  the  analysis  to  models  (1),  (2),  (3) 
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from  the  sales  category  and  models  (5),  (7),  and  (8)  from  the 
orders  category.   Differences  in  forecast  accuracy  among  backlog- 
to-sales  groups,  seem  to  depend  on  the  various  models.   For  those 
models  using  only  sales  data,  firms  with  the  smallest  backlog-to- 
sales  ratio  seem  to  have  the  largest  sales  forecast  errors  and  the 
firms  with  the  largest  backlog-to-sales  ratio  seem  to  have  the 
smallest  forecast  errors.   In  contrast,  for  the  models  using  orders 
data,  there  is  a  tendency  for  firms  in  the  middle  backlog-to-sales 
group  to  have  the  smallest  forecast  errors. 

The  statistical  significance  of  these  differences  is  shown  in 
Table  6.   In  effect,  the  statistical  test  used  here  was  a  test  of 
the  "simple  main  effects"  of  the  backlog-to-sales  groups. 

Considering  first  the  best  models  that  used  only  past  sales, 
i.e.,  models  (1),  (2),  (3),  there  are  significant  differences  be- 
tween the  long  and  short  delivery  period  groups  in  five  of  the  six 
cases,  taking  the  results  for  the  MARE  and  the  MSRE  metrics  together. 
When  examining  the  relationship  for  the  forecast  models  that  em- 
ployed new  orders  data,  i.e.,  models  (5),  (7),  and  (8),  the  re- 
sults are  less  clear.   However,  there  is  a  tendency  for  the  middle 
backlog-to-sales  ratio  group  to  have  the  lowest  forecast  errors. 
The  results  are  stronger  based  on  the  MARE  metric  than  the  results 
based  on  the  MSRE  metric. 
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SUMMARY  AND  CONCLUSIONS 

The  purpose  of  this  stucty  was  to  assess  the  direct  and  indirect 
predictive  benefits  of  Form  10-K  backlog  information  in  a  sales 
forecasting  context.  Accordingly,  ten  models  were  used  to  predict 
sales  and  a  sample  of  222  SEC-reporting  companies  provided  the 
needed  sales  and  backlog  data.   New  orders  for  each  year  were  de- 
rived from  these  data. 

We  examined  three  basic  categories  of  extrapolative  models: 
(1)  Category  I  models  based  on  sales  data,  (2)  Category  II  models 
based  on  orders  data,  and  (3)  Category  III  models  based  on  backlog 
data.   These  models  were  derived  from  the  sales  order  identity  which 
states  that  beginning  backlog  plus  new  orders  must  equal  ending 
backlog  plus  orders  shipped. 

Direct  benefits,  defined  as  those  benefits  directly  attributable 
to  the  data  and  the  models  using  the  data,  were  not  indicated  by 
the  results.  Models  using  only  sales  data  performed  as  well,  if 
not  better,  than  any  of  the  others.   Moreover,  the  models  using 
backlog  data  per  se  performed  by  far  the  worst. 

Indirect  benefits,  defined  as  those  benefits  attributable  to 
the  insights  gained  from  having  the  data,  were  assessed  by  parti- 
tioning the  sample  into  three  equal  groups  on  the  basis  of  average 
delivery  period.   It  was  hypothesized  that  firms  with  longer  de- 
livery periods  might  be  different  from  firms  with  shorter  delivery 
periods.   The  results  support  this  hypothesis.   Indeed,  the  firms 
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with  the  longest  delivery  periods  (i.e.,  backlog-to-sales  ratios) 
seemed  to  be  the  easiest  to  predict  with  Category  I  models 
(i.e.,  the  models  using  only  sales  data).   On  the  other  hand,  the 
firms  with  the  shortest  delivery  periods  seemed  to  be  the  easiest 
to  predict  with  the  Category  II  models  (i.e.,  the  models  using 
orders  data).   One  possible  explanation  of  this  phenomenon  is  that 
order  backlogs  tend  to  smooth  the  sales  series  enough  to  result  in 
better  sales  predictions  vis-a-vis  the  new  order  series.   It  appears, 
tnen,  that  sales  forecasts  using  new  orders  are  more  susceptible  to 
demand  fluctuations  which,  in  turn,  reduce  predictive  ability. 

The  exact  reasons  for  the  relatively  poor  performance  of  the 
backlog  data  per  se  are  unclear  at  this  point.   One  possibility  is 
that  the  backlog  series  are  relatively  inaccurate  predictors  of 
future  sales  due  to  order  cancellations,  rescheduling,  and  other 
factors.   Another  possiblility  is  that  an  annual  forecast  horizon 
may  be  too  long.   Thus,  further  research  is  needed  to  determine 
the  usefulness  of  backlog  data  in  other  contexts,  and  until  such 
research  is  completed,  the  usefulness  of  backlog  data  remains  at 
issue.   Perhaps  SEC  backlog  data  should  be  published  more  fre- 
quently or  the  annual  data  should  be  used  for  other  purposes. 
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FOOTNOTES 

Since  demand  fluctuations  are  unobservable,  they  are  usually 
estimated  by  economists  in  terms  of  fluctuations  in  the  volume  of 
new  orders.   On  the  other  hand,  in  operations  research,  demand  is 
often  approximated  in  terms  of  shipments.   Conrad  [1976]  notes  that 
the  newsboy  problem,  for  example,  makes  use  of  historical  sales 
data  as  a  proxy  for  the  demand  distribution. 

Since  input  flexibility  is  never  complete  over  an  entire 
range  of  output,  there  is  always  some  incentive  to  stabilize 
production  relative  to  demand  [Zarnowitz,  1962,  p.  370]. 

3 
For  instance,  some  changes  in  inventories  could  be  due 

simply  to  discontinuities  in  LIFO  layering,  as  well  as  purposeful 

shifts  in  inventory  policy. 

4 
In  the  economics  literature  this  is  a  rather  common  assump- 
tion regarding  the  determinants  of  sales  volume. 

The  ratios  of  backlog-to-sales  ranged  from  .012  to  .306  (Group 
1),  from  .307  to  .633  (Group  2),  and^rom  .6342to  2.528  (Group  3). 
6  g  (a.-  -  a) 

The  measure  is  e  =  x — "^ ^s =— t 

(g  -  l)(EZo^k  -  2gEof  +  g V 

where   a  =  the  mean  of  all  entries  in  E, 

a..    =  the  mean  of  all  entries  of  the  main  diagonal  of  E, 
23 

a.   =  the  mean  of  all  entries  in  row  j  of  E,  and 

a.,  =  the  entry  in  row  j,  column  k  of  E  (Winer,  p.  523). 
jk 

The  computed  e  values  were  .253  and  .121  for  the  MARE  and  MSRE  metrics, 
respectively. 

7See  Kirk  [1968,  pp.  263-267],  or  Winer  [1971,  pp.  544-545]. 
The  test  takes  the  following  form  [Winer,  p.  544]: 

AB . .  -  AB . . 

t  .  2j — a 


/2[MS      /  n  +  (g  -  DMS      f.   J/nrg 
error  (a)    °       error  (b) 

The  denominators  of  the  ^-ratios  used  in  the  tests  were  .024  and  .029 
for  the  MARE  and  the  MSRE  metrics,  respectively. 
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TABLE   5 
PAIRWISE  COMPARISONS  OF  FORECASTING   RESULTS 


MARE 

MSRE 

Model 

Model 

Model 

Mode 

•1 

Pairs 

F  Stat. 

Pairs 

F  Stat. 

Pairs 

F  Stat. 

Pairs 

F  Stat. 

(1) 

(2) 

-.561 

(3) 

(9) 

-8.155* 

(1) 

(2) 

-.651 

(3) 

(9) 

-4.112* 

(1) 

(3) 

-1.349 

(3) 

(10) 

-10.252* 

(1) 

(3) 

-1.168 

(3) 

(10) 

-3.810* 

(1) 

(A) 

-4.449* 

(4) 

(5) 

3.583* 

(1) 

(4) 

-2.415 

(4) 

(5) 

2.090 

(1) 

(5) 

-.866 

(4) 

(6) 

-5.033* 

(1) 

(5) 

-.325 

(4) 

(6) 

-3.500* 

(1) 

(6) 

-9.483* 

(4) 

(7) 

2.225 

(1) 

(6) 

-5.915 

(4) 

(7) 

1.131 

(1) 

(7) 

-2.224 

(4) 

(8) 

1.621 

(1) 

(7) 

-1.284 

(4) 

(8) 

.398 

(1) 

(8) 

-2.829 

(4) 

(9) 

-5.055* 

(1) 

(8) 

-2.017 

(4) 

(9) 

-2.865* 

(1) 

(9) 

-9.504* 

(4) 

(10) 

-7.152* 

(1) 

(9) 

-5.280* 

(4) 

(10) 

-2.563* 

(1) 

(10) 

-11.601* 

(5) 

(6) 

-8.616* 

(1) 

(10) 

-4.978* 

(5) 

(6) 

-5.590* 

(2) 

(3) 

-.788 

(5) 

(7) 

-1.358 

(2) 

(3) 

-.517 

(5) 

(7) 

-.959 

(2) 

(4) 

-3.888* 

(5) 

(8) 

-1.962 

(2) 

(4) 

-1.764 

(5) 

(8) 

-1.692 

(2) 

(5) 

-.305 

(5) 

(9) 

-8.638* 

(2) 

(5) 

.327 

(5) 

(9) 

-4.955* 

(2) 

(6) 

-8.921* 

(5) 

(10) 

-10.735* 

(2) 

(6) 

-5.264* 

(5) 

(10) 

-4.653* 

(2) 

(7) 

-1.663 

(6) 

(7) 

7.258* 

(2) 

(7) 

-.633 

(6) 

(7) 

4.631* 

(2) 

(8) 

-2.267 

(6) 

(S) 

6.654* 

(2) 

(8) 

-1.366 

(6) 

(8) 

3.898* 

(2) 

(9) 

-8.943* 

(6) 

(9) 

-.021 

(2) 

(9) 

-4.629* 

(6) 

(9) 

.635 

(2) 

(10) 

-11.040* 

(6) 

(10) 

-2.119 

(2) 

(10) 

-4.327* 

(6) 

(10) 

.937 

(3) 

(4) 

3.100* 

(7) 

(8) 

-.604 

(3) 

(4) 

1.247 

(7) 

(8) 

-.733 

(3) 

(5) 

.483 

(7) 

(9) 

-7.280* 

(3) 

(5) 

.843 

(7) 

(9) 

-3.966* 

(3) 

(6) 

-8.133* 

(7) 

(10) 

-9.377* 

(3) 

(6) 

-4.747* 

(7) 

(10) 

-3.694* 

(3) 

(7) 

-.875 

(8) 

(9) 

-6.675* 

(3) 

(7) 

-.116 

(8) 

(9) 

-3.263* 

(3) 

(8) 

-1.479 

(8) 

(10) 

-8.773* 

(3) 

(8) 

-.849 

(8) 

(10) 

-2.961* 

(9) 

(10) 

-2.097 

(9) 

(10) 

.302 

♦Significant  at  s  <    .05    (test  value  -  3.085  and  2.450  for  MARE  and  MSRE, 
respectively). 
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TABLE  6 


SALES  FORECAST  ERROR  DIFFERENCES  BETWEEN  BACKLOG-TO- SALES  GROUPS 


MARE 

MSRE 

Model 

Delivery  Period 
Group  Differences 

a 

Delivery  Period 
Group  Differences 

S-M 

M-L 

S-L 

S-M 

M-L 

S-L 

(1) 

.004 
(.167) 

.015 
(.625) 

.019 
(.792) 

.031 
(1.069) 

.008 
(.275) 

.038* 
(1.310) 

(2) 

.023 
(.958) 

.020 
(.833) 

.043** 
(1.792) 

.030 
(1.034) 

.020 
(.690) 

.050** 
(1.724) 

(3) 

.019 
(.792) 

.017 
(.708) 

.036* 
(1.50) 

.043 
(1.483) 

.007 
(.241) 

. 050** 
(1.724) 

(5) 

.024 
(1.000) 

.043** 
(1.792) 

-.021 
(-.875) 

.033 
(1.138) 

-.026 
(.896) 

.007 
(.241) 

(7) 

.001 
(.004) 

-.084** 
(-3.500) 

-.083** 
(-3.458) 

.034 
(1.172) 

-.036 
(-1.241) 

-.002 
(.069) 

(8) 

.040** 
(-1.667) 

-.007 
(-.292) 

-.033* 
(-1.375) 

.038* 
(1.310) 

-.009 
(.310) 

.039* 
(1.345) 

Delivery  period  group  differences  are  summarized  from  Tables  2  and  3; 
S,  M,  and  L  refer  to  short,  medium,  and  long  delivery  period  groups, 
respectively. 

t-statistics  are  in  parentheses. 


**Signif icant  at  a   <_   .05  (two  tailed  test) 
*Significant  at  a  <_  .10  (two  tailed  test) 
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